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Apparatus and Method For Enhancing Dynamic Range 
OF Charge Coupled Device-Based Spectrograph 



background of the invention 

1 . Field of the Invention 

5 The present invention relates to optical imaging. More particularly, the present 

invention relates to reading out spectral data from an optical sensor. Still more 
particularly, the present invention relates to an apparatus, method and software program 
product for enhancing the dynamic range of spectral data read from an imaging sensor. 

2. Description of Related Art 

10 The present invention relates to optical spectroscopy measurement instruments 

which employ an array of sensors in the focal plane to provide substantially simultaneous 
measurement of light intensity at multiple wavelengths over a broad wavelength range. 
The advantage of being able to monitor many wavelengths at once has led to the 
proliferation of these instruments, known collectively as spectrographs. Prior to the 

15 development of solid state sensor arrays, the spectroscopy instrument of choice was the 
monochromator. In a monochromator, a single narrow wavelength region is selected for 
measurement, and a single detector is used. The ability to make simultaneous 
independent measurements at different wavelengths is a significant advantage in many 
applications. Nevertheless, performance limitations of available detector arrays often 

20 prevent the use of spectrographs in some demanding applications. One important 

limitation is dynamic range. It is a general property of solid state sensor arrays that they 
can only simultaneously measure signals whose magnitude lies within a specific range 
known as the dynamic range. It is this limitation that is addressed by this invention. 

A spectrograph in the prior art consists of an optical imaging system, a light 
25 detecting system, and a data processing element. The optical imaging system analyzes 
light into its component spectral features. The analyzed light is converted to an electrical 
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signal by the light detecting system, and the electrical signal is converted to a numerical 
or graphical representation of the light's intensity as a function of wavelength and time 
by the data processing element. 

A good detailed description of the optical imaging component of a spectrograph is 
5 "The Optics of Spectroscopy: a Tutorial," by J. M. Lemer and A. Thevenon, which is 
incorporated herein by reference in its entirety. It is available on the World Wide Web at 
the site of the Jobin Yvon Horiba company at http://www.jyhoribaxo.uk/jy/oos/oosLhtm. 
In a typical spectrograph, light enters through a slit and is dispersed by a grating or prism 
by an angle dependent on the wavelength. The slit is imaged in the focal plane, and the 

10 image can be visualized as a rectangle with the long dimension which corresponds to 
wavelength determined by the dispersion (FIG. 1). The useful wavelength range of the 
spectrograph consists of a continuous distribution in wavelength between short and long 
wavelength limits X\ andA^N- The other dimension is determined by the slit length, the 
imaging characteristics of the optics, and the required performance, since in practice, the 

15 wavelength separation is usually best in the middle and degrades as one goes towards the 
edges. 

The light detection system in a spectrograph is a detector array placed in the focal 
plane which allows readout of the spectral information. In order to have good spectral 
resolution, it is desirable that the individual sensor elements (pixels) be small in the 

20 wavelength dimension. A typical dimension is on the order of 1 0 micrometers. In the 
other dimension, it is usually desirable to have each pixel be as large as possible, up to 
the iiseable dimension of the image, in order to have a good signal-to-noise ratio. For 
spectrographs used in the ultraviolet to near-infrared range (about 190 nm to 1 100 nm), 
photodiode arrays (PDAs), charge-coupled devices (CCDs) and charge injection devices 

25 (CIDs) are commonly used detectors. 

PDAs are linear arrays of square or rectangular sensors. In this application, the 
sensors are distributed along the wavelength axis of the image. In that direction, a typical 
dimension is on the order of 10 micrometers. In the other direction, the pixels may be as 
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long as several hundred microns or longer. An example of a PDA designed for 
spectroscopy is the RL 1 2 1 OLGQ-7 1 1 made by Perkin Elmer Optoelectronics, Inc., 2 1 75 
Mission College Boulevard, Santa Clara, CA 95054; Telephone: (408) 565-0850) which 
has a total light sensing area of 2.5 mm by 25.6 mm. It is divided into 1024 sensor 
5 elements each with dimensions of 25 microns by 2500 microns. The rectangular pixels 
are suited to the simultaneous requirements of being small along the wavelength axis and 
large along the slit direction. 

For demanding applications, however, CCDs are often preferred over PDAs, since 
in CCDs the inherent electrical noise can be made much lower. A detailed description of 

10 a modem CCD used for spectroscopy can be found in the document "An Introduction to 
Scientific Imaging Charge-Coupled Devices" published by Scientific Imaging 
Technologies, Incorporated, which is incorporated herein by reference in its entirety and 
available on the World Wide Web at the address http://www.autovision.net/CCDs.pdf or 
http://www.site-inc.com/pdf/introdat.pdf. An example of such a CCD is the 87031-1007 

1 5 device manufactured by the Hamamatsu Corporation of Japan (HAMAMATSU 

PHOTONICS K.K., Solid State Division; 1 126-1 Ichino-cho, Hamamatsu City, 435-8558 
Japan, Telephone: (8 1 ) 053-434-33 1 1 , Fax: (8 1 ) 053-434-5 1 84, 

http://www.hamamatsu.com; U.S.A.: Hamamatsu Corporation: 360 Foothill Road, P.O. 
Box 6910, Bridgewater, N. J. 08807-0910, U.S.A., Telephone: (908) 231-0960. The 
20 total light sensing area of this device is 25.6 mm by 3.1 mm The total sensing area is 
nearly the same as that of the PDA referenced above, but, as is typical of CCDs, the 
individual pixels are small and square (24 microns on a side) and arranged in a two- 
dimensional array. 

FIG, 2 is a diagram which generally depicts the functional elements of a typical 
25 CCD sensor including array 200 which is configured as a square (or rectangular) N x M 
array of pixels 202 having N lines of M pixels each, configured in a parallel shifting 
architecture, serial shift register 206 comprised of a plurality of individual shift registers, 
summing well 210 and amplifier 212. As shown in the diagram, array 200 is generally 
configured as N parallel lines of M pixels each. Each pixel is each coupled to another for 
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transporting charges vertically down the columns, from row to row, in parallel to 
individual shift registers 206-1 through 206-N of serial shift register of serial register 206. 
Each of pixels 202 transfers charge vertically in only one direction. The last row of the 
array is serial (or horizontal) shift register architecture 206 which transfers charge in an 
5 orthogonal direction to that of the parallel architecture using shift registers 206-1 through 
206-N using the same coupling between registers. Every pixel may be read individually, 
or the charge from groups of pixels may be read together in various ways. 

As well understood by those of ordinary skill in the art, a CCD operationally 
converts light photons to charge in any pixel being struck by the photon and the charge is 

10 then held in the pixel well until readout. An individual pixel well holds a finite amount 
of charge, which is defined as its full well capacity, above which the well becomes 
saturated. The period of time that the CCD sensor is exposed to light and charge is 
allowed to accumulate in the pixel wells is referred to as the ''integration time,'' After the 
integration time has elapsed, the array is read. In the case where the signal from each 

15 pixel is to be read individually, array readout commences by the simultaneous clocking 
all rows of charges one pixel toward horizontal shift registers 206-1 through 206-N. The 
charges are shifted between pixels 202 by means of the parallel shift architecture from 
one horizontal row of pixels to the next horizontal row from top to bottom of pixel array 
200. The bottom row of charge is transferred into the linear array of shift registers 206-1 

20 through 206-N. Serial shift register architecture 206 then serially transfers the charge out 
of the sensor, making room for the next row to be shifted down, and the next, and so on. 
The resulting stream is a pixel-by-pixel, row-by-row representation of the photons 
striking the CCD sensor. However, prior to being transferred serially off-chip, each 
pixel's charge is amplified by amplifier 212, resulting in an analog output signal of 

25 varying voltage which is proportional to the pixel charge. Located between amplifier 212 
and last serial shift register 210-N is summing well 210, which is used for pixel binning 
operations. 

In an effort to fiirther reduce electrical noise and improve the signal-to-noise ratio, 
albeit at the expense of reduced spatial resolution, the array can be read by a process 
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known as ^'pixel binning. " Pixel binning is generally understood by those of ordinary 
skill in the art as a clocking scheme used to combine the charge collected by adjacent 
CCD pixels. Binning the charge from blocks of adjacent pixels reduces noise by creating 
a larger sample area on the CCD. Binning is typically performed in either "area binning 
5 mode'' or ''line binning mode." In area binning mode charge from a square or rectangular 
array of pixels is combined into a super-cell value by the sensor and then output for 
further processing, e.g., 2x2 binning combines the charges from a block of four pixels 
into a single output signal; 3x3 binning combines the charge from nine pixels and so on. 

The 2x2 binning process involves two consecutive vertical shifts into the serial 

10 shift register, and a series of horizontal shifts, two at a time, into the summing well. 

Operationally, following the integration period, the charge from the two horizontal pixel 
rows closest to the horizontal shift registers are read in parallel readout and shifted into 
their respective horizontal shift registers, thereby aggregating two pixel's charges into a 
single horizontal shift register. The charge from every other pixel in each line is also 

15 transferred two pixels closer to the horizontal shift registers. After two vertical shifts, 
two consecutive horizontal shifts move the charge from two end registers into the 
summing well. The summing well then holds a cumulative charge from the 2 x 2 block 
of pixels, which is then amplified and converted to a voltage for fiirther ofF-chip 
amplification and digitization. Charge from any number of pixels can be shifted into a 

20 shift register, but once the well of the shift register is saturated, any additional charge 
shifted from the pixels is disregarded. If any charge is not retained in a horizontal shift 
register, the intensity for the binned pixel is incorrect, i.e., reduced by the amount of the 
charge not retained in the line shift register. In spectroscopy applications, line binning 
mode is typically used for readout. FIG. 3 is a diagram depicting the spectral image of 

25 FIG. 1 superimposed over the sensing portion of the pixel array of a CCD sensor as 

depicted in FIG- 2. Notice from the diagram that the spectra wavelengths correspond to 
the vertical lines of pixels in array 200. Since the individual pixels are small, the signal 
from many pixels corresponding to the same wavelength are typically binned to 
effectively create a single rectangular sensor for each wavelength. By using this 
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correspondence, the level of noise can be reduced and the signal-to-noise ratio is 
improved by binning the pixels corresponding to the spectra wavelengths into a single 
super-cell. This is done by reading the CCD in line binning mode. 

FIG. 4 is a flowchart depicting a process for reading out an N x M pixel array 
5 CCD sensor in line binning mode according to the prior art. The binning process begins, 
after each integration by vertically reading out the pixel signals of each line. Charge is 
shifted down the N vertical shift registers, in parallel row-by-row fashion, to the N 
horizontal shift registers (step 402). Vertical shifting accumulates the charge of each 
pixel line into the last shift register of the column, which is actually a horizontal shift 
10 register in the serial shift register. Next, the charge fi-om each of the N pixel lines is 
shifted out of the N horizontal shift registers, column-by-column, in N horizontal shifts 
(step 404). Rather than summing these charges in a summing well, the line pixel data is 
output off the chip in a column-by-column fashion (step 406). The result of reading the 
CCD is an analog signal whose amplitude varies with time. The analog signal is then 
15 ampUfied, converted into a digital form, whereupon the necessary calculations are 
performed so that the data can be represented, e.g., as a table of light intensity vs. 
wavelength. Typically, the intensity values are presented as integer values within some 
convenient range, as, for example, 0 - 65535 in the case where a 16-bit digitizer is used. 

The dynamic range of a CCD is related to the ratio of well depth to the readout 
20 noise, usually expressed in decibels. The Hmitation to dynamic range in a CCD-based 
spectrograph exists because there is a limit to the amount of charge that each pixel and 
each horizontal shift register can hold. Inaccurate measurements result if the charge 
accumulated in any pixel, or any shift register, reaches this saturation level. By contrast, 
several noise sources exist in the readout process which cause inherent uncertainty in the 
25 measurement of the charge in any shift register. Therefore, the usefiil range of a 

measurement is when the charge is between the inherent noise level and below the full- 
well, or saturation level. A typical dynamic range specification for a scientific-grade 
CCD intended for spectroscopy is 75000. 
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As alluded to above, the amount of charge which accumulates in a column of 
pixels of a spectroscopy CCD array is proportional to both the light intensity at the 
wavelength which illuminates that column and the amount of time that charge is allowed 
to accumulate before it is read. Again, that time is defined as the integration time. The 

5 integration time has to be chosen so that the quantity of charge in each column lies within 
the useful range. A problem occurs if the spectrum of interest includes regions of widely 
differing intensity, since there may be no single integration time which is suitable for the 
entire spectrum. Furthermore, for spectra including extremely bright features, it may not 
be possible to use an integration time short enough to prevent saturation of the brightest 

10 lines, since the minimum achievable integration time is the time it takes to perform one 
full vertical and one full horizontal shift. 

The dynamic range limitation has been dealt with in many different ways, some of 
which are mentioned here. One way is to interleave spectral acquisitions using different 
integration times. A single composite spectrum with high dynamic range can be derived 

15 from individual spectra acquired using different integration times. However, this 
approach does not solve the problem of lines which are saturated at the shortest 
integration time. Another approach, described by Brooks (U.S. Patent 5,675,411) which 
is incorporated herein by reference in its entirety, is to incorporate a photomask into the 
spectrometer to selectively attenuate bright lines. However, this approach is not 

20 applicable if the spectrograph is to be used to analyze diverse sources. Yet another 
approach is to modify the design of the sensor to improve the dynamic range. One 
example of this is the sensor described by Yadid-Pecht, et al. in U.S. Patent 6,175,383, 
which is also incorporated herein by reference in its entirety. Yadid-Pecht et al teach 
incorporating circuitry that allows the integration time on each pixel to be individually 

25 set. Considerations of cost and manufacturability, however, make it desirable to have an 
alternative approach which is applicable to existing high-performance CCDs of moderate 
cost. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The novel features believed characteristic of the present invention are set forth in 
the appended claims. However, the invention itself, as well as a preferred mode of use, 
further objectives and advantages thereof, will be best understood by reference to the 
5 following detailed description of an illustrative embodiment when read in conjunction 
with the accompanying drawings wherein: 

FIG, 1 is a diagram illustrating the image from a spectrograph, wherein the longer 
dimension (horizontal) corresponds to wavelength as generally understood in the prior 
art; 

10 FIG. 2 is a diagram which generally depicts the functional elements of a typical 

CCD sensor as generally understood in the prior art; 

FIG. 3 is a diagram depicting the spectral image superimposed over the sensing 
portion of the pixel array of a CCD sensor as generally understood in the prior art; 

FIG. 4 is a flowchart depicting a process for reading out an N x M pixel array 
1 5 CCD sensor in line binning mode according to the prior art; 

FIG. 5 is a diagram which generally depicts a tj^ical CCD sensor, as known in 
the prior art, of N x M array of pixels which have been subdivided into region a and 
region b in accordance with an exemplary embodiment of the present invention; 

FIG. 6 is a flowchart depicting the process for reading out a N x M pixel array 
20 CCD sensor in two-region line binning mode in accordance with an exemplary 
embodiment of the present invention; 

FIG. 7 is a flowchart depicting a method for implementing the present two-region 
line binning methodology in optical spectroscopy measurements using an optical sensor 
having a N x M pixel array in accordance with an exemplary embodiment of the present 
25 invention; 
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FIG. 8 is a flowchart depicting a post-processing method for combining the 
small- and large-amplitude channel measurements into a single wide-dynamic-range 
spectrum in accordance with an exemplary embodiment of the present invention; 

FIG. 9 is a diagram illustrating the low intensity region of a spectrum read out in 
5 two channels, in accordance with an exemplary embodiment of the present invention; 

FIG. 10 is a diagram illustrating the high intensity region of the spectrum read out 
in two channels, in accordance with an exemplary embodiment of the present invention; 

FIG. 11 is a diagram of the spectral images in the focal plane of an imaging 
spectrograph wherein the image is visuaUzed as a rectangle with the long dimension 
10 corresponding to wavelength; 

FIG. 12 is a diagram which generally depicts a device for carrying out a variation 
of the two-region line binning technique applicable to imaging spectrographs in which 
two or more images are projected in accordance with an exemplary embodiment of the 
present invention; and 

15 FIG- 13 is a flowchart of a process for reading out charge accumulated in 

multiple regions on a N x 2M pixel array without contaminating charge accumulated in 
one region with charge accumulated in another region in accordance with an exemplary 
embodiment of the present invention. 

Other features of the present invention will be apparent from the accompanying 
20 drawings and from the following detailed description. 
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DETAILED DESCRIPTION OF THE INVENTION 



The invention being disclosed here is a spectrograph consisting of an optical 
dispersing and imaging system, a CCD for light detection, and a data processor. The 
CCD employs a heretofore unknown pixel binning method, the '^two-region line binning 
5 mode,'' for increasing the dynamic range over what can be achieved in the conventional 
line binning mode. The data processor converts the electrical signals produced in this 
method to a numerical or graphical representation of the light' s intensity as a function of 
wavelength. 

The presently described invention is applicable to spectrographs using a CCD 
10 with a two-dimensional array of pixels, wherein each parallel line pixels terminate in a 
shift register. The pixel lines may be oriented in one of the vertical (colunm) or 
horizontal (row) direction, but conventionally as a column in the vertical direction. 
Additionally, the present invention applicable for CCDs in which the full well capacity of 
the individual horizontal shift register is less than the sum full well capacities of the 
1 5 individual pixels making up a column, and is particularly applicable for CCDs in which 
the full well capacity of the shift registers is on the same order as (1 to 12 times) the pixel 
fall well capacity. Examples of commercially produced charge coupled devices to which 
it applies are any of the CCDs of the S7030/S7031 series of CCD Area Sensors 
(HAMAMATSU PHOTONICS K.K., Solid State Division; 1126-1 Ichino-cho, 
20 Hamamatsu City, 435-8558 Japan; Telephone: (81) 053-434-3311; Fax: (81)053-434- 
5184, http://www.hamamatsu.com; U.S.A.: Hamamatsu Corporation: 360 Foothill Road, 
P.O. Box 6910, Bridgewater, N. J. 08807-0910, U.S.A.; Telephone: (908) 231-0960. 

In the Hamamatsu devices, the charge storage capacity of the horizontal shift 
registers is twice the capacity of an individual pixel. When these devices, and the like, 
25 are employed for spectroscopy in line binning mode, a single horizontal shift register 
receives the charge from up to 256 pixels, depending on the specific device. When a 
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spectrum containing some bright spectral lines is read saturated, the shift registers fill up 
before the individual pixels do, provided only that the illumination along the colunms is 
reasonably uniform. The spectrum is truncated at the maximum value for the shift 
register because any charge over the full well capacity of the shift register is disregarded, 
5 The presently described binning methodology prevents the knowledge of the amplitude 
of the bright lines from being lost without substantially reducing the signal-to-noise of 
the measurement of the small signals elsewhere in the spectrum. 

This is briefly achieved by segmenting each (horizontal) line of the CCD array for 
binning as a small-ampHtude channel and a large-amplitude channel. FIG. 5 is a diagram 

10 which generally depicts a device for enhancing the dynamic range of charge coupled 
device-based by carrying out two-region line binning in accordance with an exemplary 
embodiment of the present invention. Device 500 includes a typical CCD sensor, as 
shown in FIG. 2, generally comprising array 200 (configured as a square or rectangular) 
of N x M array of pixels 202, which have been subdivided into region a and region b in 

15 accordance with an exemplary embodiment of the present invention. Accordingly, the 
surface area of sensor 200 is shown as two separate regions: a smaller region having 
a X N pixels (depicted as the shaded region of pixels), and a large region having 
(M - a) X N pixels. The values of a and b will generally be chosen to optimize a specific 
case, but typically b will be between 10 and 100 times larger than a. Ordinarily, signals 

20 from region a will produce smaller amplitude levels, i.e, , the small-amplitude channel 
(alternatively referred to as the a-channel), while signals from region b will produce 
amplitude levels, Le., the large-amplitude channel (alternatively referred to as the b- 
charmel). As can be understood from array 200 in FIG- 5, region a defines a number of 
pixel rows on the array and region b defines a number of pixel rows on the array such that 

25 for any column, a + 6 = M (where M is the total nuniber of rows on array 200). 

Device 500 also includes components for controlling the readout of CCD 200 and 
processing the signals obtained therefrom in accordance with other exemplary 
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embodiments of the present invention. These components generally transfer and receive 
data, addresses, and timing along a series of system buses depicted herein generally as 
bus 520. The system components include processor 502 for executing instructions stored 
in memory, either nonvolatile memory 504 or RAM 506. These instructions pertain 

5 generally to device operations including readout shifting instructions for CCD 200 via 
CCD controller 510. System clock 508 provides system clocking for shift operations. 
Processors 502 may also execute instructions pertaining to post-processing of signals 
ft-om CCD 200. Typically, these signals are output as analog and converted to digital 
representation using A/D converter 512 and buffered in channel buffers 514 while 

10 awaiting post-processing. Alternatively, the digital signal may be temporarily stored in 
RAM 504 prior to post-processing operations. Once processed, the data may be stored in 
RAM 506. or more permanently in nonvolatile memory 504. Eventually, the processed 
data are read out of memory and displayed. While embodiments of the present invention 
refer to device 500 as a spectrograph, it should be understood that the presently described 

15 invention may be implemented in any device currently using line binning for achieving 
enhancing dynamic range of charge coupled imaging device. 

In accordance with one exemplary embodiment of the present invention, the 
spectrum is to be read independently fi'om pixels located in each region. If the value of a 
is much smaller than that of 6, then the large region b will yield a measurement which is 

20 not significantly degraded fi*om what it would have been had the entire (a + b) x M 
region been read in conventional line binning mode. The amplitude reading from the 
large region b will yield a larger amplitude than that from the smaller region a and is 
referred to herein as the large-amplitude channel. Thus, the signal-to-noise ratio obtained 
from pixels in the column of region b(M-a pixels) remains comparable to that from the 

25 pixels in the respective column of M pixels. Another copy of the spectrum is read from 
region a (the smaller region). The amplitude reading from the small region a will yield a 
smaller amplitude than that obtained from the large region b and is referred to as the 
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small-amplitude chamiel. Particular attention is paid to the bright portions of the 
spectrum which were saturated in the spectrum read from the large region b. 

As mentioned elsewhere above, CCD array 200 is assumed to have N columns 
distributed along the dispersion (wavelength) direction, each consisting of M pixels. 

5 According to the prior art line binning readout mode employed in spectroscopy, the 
charge from each column of pixels is simultaneously shifted into a respective horizontal 
shift register, and then the charge is shifted out of the horizontal shift register and 
detected, as described in detail above. By contrast, and in accordance with an exemplary 
embodiment of the present invention, the CCD readout is performed in two parts. In the 

10 first part, a small number a of pixels from each colunrn are transferred into their 

respective shift registers. Then the charge is shifted out of the horizontal shift register 
and detected in the usual manner to, for example, a storage for the small-amplitude 
channel where it is available for post processing. In the second part, the charge from the 
remaining pixels (b = M-a)m each column is transferred into the shift registers. 

15 Finally, the horizontal shift register is read a second time and the large- amplitude channel 
is stored in a separate storage for post-processing. Alternatively, the small- and large- 
amplitude chaimels may be processed on the fly. 

FIG. 6 is a flowchart depicting the process for reading out a N x M pixel array 
CCD sensor in two-region line binning mode in accordance with an exemplary 

20 embodiment of the present invention. The two-region line binning process is initiated 
once at the end of each integration period when at least some of the pixel wells have had 
sufficient time to accumulate charge. Because the small region a is adjacent to the 
horizontal shift registers, that region of the pixel array is read first; however, in this 
particular exemplary embodiment, large region b could just as well be defined as adjacent 

25 to the horizontal shift registers and one of ordinary skill level in the relevant art would 
readily appreciate modification to the present binning mode from the description below. 
Region a is read out of the first a rows of the array into the N horizontal shift registers for 
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the respective pixel columns by making a total of "a" vertical shifts (step 602). The 
vertical shifting will shift not only the charge from the first a rows of the array, but all M 
rows. Subsequently, each of the horizontal shift registers will hold the accumulated 
charge from its pixel column. That charge is read out from the N horizontal shift 

5 registers in N sequential horizontal shifts (step 604). Because each of the N columns in 
the CCD sensor is associated with a discrete wavelength (or region of wavelengths), the 
accumulated charge represents intensity for the respective wavelengths, albeit small in 
amplitude. Thus, the data from each register can be transferred directly into storage as a 
small-amplitude channel wavelength measurement (step 606). Alternatively, and as will 

10 become more apparent from the disclosure below, the data from each register can be 
processed based on a relationship to the large-amplitude channel data for the particular 
wavelength (or pixel colunm). Once region a of the CCD array has been readout, region 
b can be read in a likewise manner. However, the charge from region b has now been 
shifted a rows closer to the horizontal shift registers during the previous vertical shifts. 

15 Therefore, region b is readout of the b rows of the array closest to the N horizontal shift 
registers with a total of "b" vertical shifts (step 608). With the accumulated charge from 
each pixel column of region 6 in a horizontal shift register, that charge is readout in N 
sequential horizontal shifts (step 610). Since the data in each horizontal shift register is 
associated with a wavelength, the data can be shifted directly into storage as a large- 

20 amplitude channel wavelength rneasurement (step 612). Once the large-amplitude 
channel has been stored, the small- and large-amplitude data can be processed into a 
spectrum. However, before describing the post-processing of the two-channd data in 
greater detail, an appreciation of the two-region line binning mode with more specific 
regard to obtaining optical spectroscopy measurements would be helpfiil. 

25 Initially, the data obtained from large region 6, may be generally characterized as 

having a much better signal-to-noise ratio than that data obtained from small region a. 
Depending on the region selection, the signal-to-noise ratio may approach that of the data 
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from an entire M pixel line. However, in a similar manner as the M pixel lines, the 
columns of region b (recall 6 = M - a) are susceptible to saturating in higher illumination 
regions of the spectrum. The data in the small region is much less susceptible to 
saturation, at least with regard to the well depth of the horizontal shift registers, since the 
5 area is smaller and less total charge can accumulate over the region. Therefore, in 
accordance with one aspect of an exemplary embodiment of the present invention, the 
saturated data obtained from the larger amplitude region can be supplanted with 
unsaturated data from the small amplitude region, thus enhancing the dynamic range of 
the spectral data. The data are replaced on a column-by-column basis. 

10 The values of a and b may be chosen in accordance with the enhancement of 

dynamic range desired. The improvement in dynamic range realized will be 
approximately: 



where Fp and Fh are the full-well capacities of a pixel and horizontal shift registers, 
15 respectively. For the Hamamatsu S703 1-1007 device, the theoretical maximum increase 
in dynamic range that could be achieved according to this formula is about 60 over the 
performance in line binning mode, assuming a ^ 2 and using the fact that the ratio of 
horizontaUto vertical shift register capacity is 2. The actual improvement may differ 
from the number calculated here because the spectral image formed by the optics may not 
20 be uniform in the vertical direction. It should be understood that with the improvement in 
dynamic range comes additional noise on the signal in the small-amplitude channel. This 
noise can be reduced, but only at the expense of the improvement in dynamic range. For 
instance, selecting a value of = 10 will reduce the improvement in dynamic range by a 

factor of 10, but simultaneously reduce the noise by up to a factor of ^/lO . 
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In accordance with an exemplary embodiment of the present invention, 
spectrographs utihzing the two-region hne binning mode may operate with hght sources 
bright enough to cause saturation in the line binning mode even at the shortest integration 
time available. However, the minimum integration time required for performing the two- 
5 region line binning (^ab(min)) is longer than that which might be achieved using the prior 
art line binning mode (tM{mm)) by the amount of time necessary for making additional N 
horizontal shifts (/horiz). Typically, the minimum integration time for one CCD readout in 
prior art line binning mode is defined as: 

(min) ~ ^Kert horiz (2) 

10 The two-region line binning mode involves dividing the full column vertical shift 

into two partial column shifts and an additional fiill horizontal shift as defined below: 

= ^Ker. (3) 

since advert + btycn = M/ven Equation (3) becomes: 

Umin)=^^e./+2M,,,,, (4) 

15 Assuming tj,^^^ =/^^^, , in CCD arrays where N » M; M,,^^^ »f^Kert 

therefore: 

As a practical matter, most CCD arrays used in spectrographs are configured with 
far more horizontal columns than vertical rows, N » M, so it is a good approximation to 
20 say that the cost of using the two-region line binning method is to double the minimum 
integration time which can be achieved. When dealing with very bright sources, the 
brightest source that can be measured using the prior art is that which just saturates a 
horizontal shift register when the minimum integration time is used. Using the two- 
region line binning mode, the integration time will be effectively doubled, so the same 
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source will not saturate the horizontal shift register for any value of a such that a < M/2. 
Accordingly, another way to choose a and b is to have a target value in mind for the level 
of signal in a particular column or range of columns corresponding to a range 
wavelengths, and, by use of Equation (1), choose a to yield the targeted signal level in the 
5 fl-channel. This may result in the size of region b being sufficiently reduced so that the 
signal-to-noise ratio in that channel is reduced, but in certain applications this may not be 
of concern. 

One final matter should be considered prior to employing the presently described 
two-region line binning mode, that is the establishment of a relationship between the 
10 amplitude measurements of the small-amplitude channel and the large-ampHtude channel. 
Optimally, the relationship between channels is linear for each wavelength and may be 
estabUshed by comparing one or more amplitudes fi"om each channel associated with 
each wavelength. The level of these amplitudes should be higher than the inherent 
electronic noise level of the CCD and below its saturation level. 

15 FIG. 7 is a flowchart depicting a method for implementing the present two-region 

line binning methodology in optical spectroscopy measurements using an optical sensor 
having a N x M pixel array in accordance with an exemplary embodiment of the present 
invention. It is presumed that the array is aligned with spectral wavelengths 
corresponding to pixel columns. The process begins by establishing correspondences 

20 between spectral wavelengths and each of the N pixel colunms (step 702), Typically, this 
step is often omitted as the spectrograph is normally pre-configured. Next, regions a and 
b are defined on the M x N array (step 704). Values for a and b can be determined based 
on the amount of reduction required to avoid saturating the spectrum in the a-channel 
using Equation (1) above. The enhancement in the dynamic range is the ratio of the total 

25 number of pixels in a column to the greater of a, or the number of pixels it would take to 
saturate the horizontal shift register if they themselves were saturated. As should be 
readily apparent firom Equation (1), the maximum dynamic range enhancement is 
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achieved where a = Fh/F, and as the value of a increases, a > 1, the signal-to-noise ratio 
increases on the large-amplitude channel. 

It is expected that the spectral data from a large-amplitude channel would be used 
everywhere except in wavelengths with amplitudes indicating they are in saturation, in 
5 which case the small-amplitude channel would be used. One exemplary means for 

handling the data is to combine the information from both the small- and large-amplitude 
channels into a single, wide-dynamic-range spectrum. This may be accomplished by 
establishing a linear relationship between the amplitudes in the respective channels, and 
linearly scaling the data from a small-amplitude chaimel using that relationship (step 
10 706). A relationship may be determined, optimally a single relationship, but if necessary 
a different relationship for each wavelength, by comparing amplitudes from the two 
channels across the working range of the large-amplitude channel, i.e., at amplitudes 
sufficiently above the electronic noise and below saturation. The linear relationship data 
for each wavelength is necessary for each wavelength is then stored for use in post- 
15 processing the amplitudes. The relationships are generally device-specific and therefore 
should be determined for each spectrograph to be operated in two-region line binning 
mode. 

Once the desired improvement in dynamic range and the linear relationships 
between the amplitude channels have been determined, the optical spectroscopy 

20 measurements may be taken in two-region line binning mode (step 708). As mentioned 
above, the presently described two-region line binning mode will yield two data channels 
of raw spectroscopy data each readout, a large-amplitude data channel, and a small- 
amplitude data channel. Data in these two chaimels from may be post-processed into a 
more usefiil form (step 710). One way is to merely present the altemating reads as 

25 separate channels in a two-channel spectrograph. The large-amphtude channel would be 
used everywhere except where its amplitude indicates that it is in saturation, in which 
case the small amplitude channel would be used. 



DLI-5764260vl0 



19 



As an alternative to presenting the data as a two-channel spectrographic 
presentation, the two-channel amplitude data from both small and large-amplitude 
channels may be combined into a single, wide-dynamic-rarige spectrum. FIG. 8 is a 
flowchart depicting a post-processing method for combining the small- and large- 

5 amplitude channel measurements into a single, wide-dynamic-range spectrum in 
accordance with an exemplary embodiment of the present invention. Initially, it is 
assumed that each channel of amplitude data for a spectrum measurement is separately 
buffered. The process begins by reading the large-amplitude data out of memory 
obtained from region b (step 802). The spectrum is read one discrete wavelength after 

10 another and tested for saturation at each wavelength (step 804). If a wavelength 

amplitude is not saturated, i.e., the amplitude measurement is below the saturated value 
{e.g., 65535 counts), the amplitude measurement is added to the spectrum without further 
processing (step 812), and the spectrum is tested for completeness (step 814). If the 
spectrum is complete, it is presented as a single, wide-dynamic-range spectrum (step 

15 816). If the spectrum is not complete, the process reverts to step 802 and reads another 
wavelength from the buffer holding the large-amplitude channel data and that amplitude 
is tested for saturation (step 804). When a wavelength amplitude is determined to be 
saturated, the small-amplitude channel amplitude is read from the small-amplitude buffer 
for the corresponding wavelength (step 806). Since the small-amplitude data is sampled 

20 from fewer pixel rows than the large amplitude data, the amplitude is smaller than the 
larger-amplitude data, but linearly related. The linear relationship for the wavelength, 
determined by the technique described in step 706 aboye, is retrieved (step 808), and 
applied to the amplitude of the small-amplitude channel (step 810). By doing so, the 
amplitude from the small-amplitude channel is scaled proportional to the large-amplitude 

25 channel. That amplitude can then be added to the spectrum (step 812), and the spectrum 
is tested again for completeness (step 814). The process iterates through the wavelengths 
of the spectrum imtil an entire wide-dynamic-range spectrum has been assembled, one 
wavelength at a time. The resultant wide-dynamic-range spectrum is composed primarily 
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from the amplitude measurements of the large-ampUtude chamiel. Since the signals 
whose measurements are derived from the small-amplitude channel are large, they are riot 
susceptible to interference by the much smaller noise level, while the small signals which 
are susceptible to such interference are derived from the large-amplitude channel which is 
5 nearly as noise- free as spectral data generated using the prior art line binning mode 
(especially in applications where b»a and M^b). Therefore, the dynamic range of 
the composite spectrum is much larger than that of a spectrum generated using the prior 
art. 

A spectrograph (SD1024) manufactured by Verity Instruments, Inc., 2901 
10 Eisenhower Street, CarroUton, TX 75007 was modified to use the disclosed method, 
using a = \ and 6=121. The output range of the spectrograph in line binning mode is 
0-65535. The spectra were read out in separate channels, and the small-amplitude 
channel was re-scaled to the same scale as the large-amplitude channel. The high- 
intensity channel is essentially the same as what would have been observed if 
15 conventional line binning had been used. The enhancement to the dynamic range which 
. was observed was a factor of 23. FIG. 9 is a diagram illustrating the low intensity region 
of a spectrum read out in two channels, in accordance with an exemplary embodiment of 
the present invention. FIG* 9 shows a portion of a spectrum where the intensity is low, 
so neither channel is saturated. In this region, the large-amplitude channel (left) gives 
20 better results. The small-amplitude channel (right) has been re-scaled so as to make the 
scale the same as that of the large-amplitude channel (left). Since neither the large- 
amplitude channel nor the small-amplitude channel is saturated, the better measurement 
in this region comes from the large-amplitude channel. 

FIG. 10 is a diagram illustrating the high intensity region of the spectrum read out 
25 in two channels (the spectrum shown in FIG. 9), in accordance with an exemplary 

embodiment of the present invention. In this region, the large-amplitude channel (left) is 
saturated, but the small-amplitude channel (right) gives usable results. The large- 



DU-5764260V10 



21 



amplitude channel (left) is truncated at 65536 counts, and is unusable because of 
saturation. The re-scaled small-amplitude channel (right) saturates at 1,500,000 counts. 
The increase in dynamic range is 23 fold. 

The choice for a, or a and 6, can be made in conjunction with various events 
5 depending on the intended application for the imaging device. For instance, a value for a 
may be determined during an initial set-up stage for the imaging device. With regard to a 
spectrograph, test data may be gathered and used for selecting a value for a, or a and b, 
such that the signal amplitude of one or more selected wavelengths from either the a- 
channel or 6-channel fall within a range of target amplitudes. 

10 Alternatively, a value for a may be determined on the fly between sequential 

imaging sensor readouts and used thereafter. This mode of operation is extremely useful 
for certain applications in which a series of spectrographic measurements are taken of, for 
instance, an ongoing process. In accordance with this exemplary embodiment of the 
present invention, a time or point in the process is determined for selecting a value for a, 

15 or a and b. At the predetermining point in the process, the amplitude of one or more 
selected wavelengths from either the a-channel or fe-chaimel are compared to a range of 
target amplitudes. If the signal amplitude falls within the target range, no fiirther 
adjustments of the value of a, or a and b, are necessary. If not, the value of a, or a and 6, 
is adjusted in the desired direction and another measurement is taken. The value of ^, or 

20 a and 6, is iteratively adjusted between measurements until the signal amplitude falls 
within the range of targets amplitudes. Once set, the values of a and b remain fixed for 
the remainder of the process. With regard to a specific example, if a signal amplitude for 
a selected wavelength is too high on the fc-channel and too low on the ^f-channel, the 
value of a may be increased in each measurement by doubling the value of a, for 

25 instance, until the amplitude of the ^-channel is within the range of target amplitudes. 

Conversely, if a signal amplitude for the selected wavelength is too high on the 6-channel 
and also too high on the a-channel, the value of a may be decreased in each measurement 
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by halving the value of a, for instance, until the amplitude of the a-channel is within the 
range of target amplitudes. In a case where both the signal amplitudes for the selected 
wavelength on the a-channel and the 6-channel are too low, one of the values for a and b 
may be increased in each measurement by doubling the value, for instance, until the 
5 amplitude of that channel is within the range of target amplitudes or until that value = M 
(no further adjustments to the value are physically possible). 

In an imaging spectrograph, the optics have the further capability to resolve 
multiple spectra from different light sources which are incident in different regions of the 
slit. FIG. 11 is a diagram of the spectral images in the focal plane of an imaging 

10 spectrograph wherein the image is visualized as a rectangle with the long dimension 

corresponding to wavelength. Spectrum 1102 is projected above a second spectrum 1104 
with a slight separation between them. In accordance with an exemplary embodiment of 
the present invention, two or more rectangular images arrayed along a direction 
perpendicular to the wavelength axis, each having its own independent intensity versus 

15 wavelength distribution, and each one reduced in extent perpendicular to the wavelength 
direction so that the total extent of the composite image is equal to the extent of the single 
image is depicted above in FIG. 1. 

The simplest example of a composite image from an imaging spectrograph is a 
two-channel spectrum, where there are two sources, say, sources C and A, each with a 

20 corresponding image region on the imaging array. In this case, the presently described 
two-region line binning mode is not appropriate, since, inter alia^ each source projects a 
separate image having an independent intensity versus wavelength distribution. Consider 
the application of two-region line binning to region A, in which it is ftirther subdivided 
into regions A' and B', these being related to the original region A in the same way as the 

25 regions a and b were related to the entire image in the case of a conventional, nonimaging 
spectrograph. At the end of an integration, the charge from part of region A, i.e., region 
A', is moved into the shift register. Simultaneously, some of the charge from region C is 
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moved into the region B' portion of region A, that region of the imaging array lying 
between region C and the shift register. The charge from region C that is now in region 
B' is exposed to light source A. While the series of horizontal shifts which are used to 
read the signal from region A' are carried out, light source A adds charge to that shifted 
5 down from region C. Eventually, when the charge from region C is read, it will be in 
error owing to the presence of charge from region A having been mixed with it. Similar 
considerations affect the signals from each region. 

FIG. 12 is a diagram which generally depicts a device for carrying a variation of 
the two-region line binning technique applicable to imaging spectrographs in which two 

10 or more images are projected, each having independent intensity versus wavelength 
distribution in accordance with an exemplary embodiment of the present invention. 
Device 1200 is similar in many aspects to device 500 described above with regard to 
FIG. 5, and therefore only the differences will be discussed. In general, however, 
imaging array 1202 is selected which has twice the number of pixels, say 2M pixels, in 

15 the direction perpendicular to the wavelength direction as are necessary to accommodate 
the composite image with the image falling on the top half of array 1202. The upper half 
of array 1202 is subdivided into regions corresponding to distinct images projected 
thereon. By way of example, top half of array 1202 is subdivided into region a having 
pixels 1204, and region c with pixels 1206. In the depicted figure, spectrum 1102 is 

20 projected on region c above spectrum 1104 Avhich is projected onto region a. In practice, 
however, the upper portion of the array exposed to the light may be subdivided into any 
number of regions without departing from the scope of the present invention. The lower 
half of array 1202 comprises a dark region with pixels 1208. The dark region lies outside 
the image and therefore pixels 1208 are never exposed to light. Alternatively, pixels 

25 1208 may be shielded from any potential light contamination with an opaque mask. 

During operation, spectrum 1102 and spectrum 1104 are projected onto regions a 
and c causing charge to accumulate in pixels 1206 and 1204, respectively. After the 
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upper half of imaging array 1202 is exposed to light for a predetermined time period, ^int, 
the entire image is rapidly shifted M pixels down into pixels 1208 of the dark region. 
Subsequent to horizontal shift registers 206 being emptied, the charge accumulated from 
region a, corresponding to spectrum 1104, is shifted in horizontal shift register 206 and 
5 then horizontally shifted out as a-channel signals. Then the charge accumulated in pixels 
1102 from region c, corresponding to spectrum 1102, may be shifted into horizontal shift 
register 206 and read out as c-channel signals. 

With further regard to carrying a variation of the two-region line binning 
technique, FIG. 13 is a flowchart depicting a detailed process for reading out charge 

10 accumulated in multiple regions on a N x 2M pixel array which includes a dark region to 
prevent contamination of charge accumulated in one region with charge accumulated in 
another region in accordance with an exemplary embodiment of the present invention. 
The present process is particularly applicable when resolving multiple spectra from 
different light sources which are incident in different regions of the imaging 

15 spectrograph's slit. Generally, the imagining array is defined as having n + 1 separate 
pixel regions. One region is the dark lower half of the array. The dark region comprises 
at least M pixel rows and lying entirely outside of the image (depicted in FIG. 12 as 
pixels 1208). n uncovered regions in the upper portion of the array are exposed to light 
(depicted in FIG. 12 as pixels 1204 and 1206 for regions a and c, respectively). 

20 Assuming only M pixel rows are in the dark region, each of the n upper regions have a 
predetermined proportion of pixel rows of the array such that region a comprises 
Ma/(a + c + . . . + n) pixel rows; region c comprises Mc/(a + c + . . . + /i) pixel rows until 
region n comprises Mn/{a + c + . . . + «) pixel rows. One or more images are projected 
onto the upper half of the array, each image corresponding to one or more of the n 

25 imcovered regions. 

A measurement cycle begins by clearing the upper portion of the array N x 2M 
imaging array by making M vertical shifts (step 1302). Subsequently, charge is 
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integrated in the n regions for a predetermined integration time period, ^int (step 1304). 
Following integration, charge accumulated in the n regions in the upper half of the array 
is moved into the dark region using M vertical shifts (step 1306). At this point in the 
process, shift registers 206 contain unwanted charge, and are therefore emptied without 
5 saving the data by making M horizontal shifts (step 1308). 

Next, charge accumulated in the open regions, /.e, regions <ar, c, . . ., and n, is 
transferred from the dark region through the shift registers and into memory as N channel 
signals using a series of iterative readouts, one readout for each region's charge stored in 
the dark region. Each readout comprises a set of vertical shifts equal to the number of 

10 pixel rows in the respective region (for shifting the charge from the dark region and into 
the N shift registers), and N horizontal shifts (for shifting the charge out of the N shift 
registers and into, for example, a memory). For the lowermost region's charge now in the 
dark region, the charge is shifted from the dark region to the N shift registers in 
Ma/{a + c + ... +«) vertical shifts (step 1322) and then out of the registers in N horizontal 

15 shifts (step 1324). The next region's charge in the dark region is transferred into the N 
shift registers with Mc/(a + c + , . . +«) vertical shifts (step 1332) and out of the N shift 
registers in N horizontal shifts (step 1334). The readout process iterates through the 
region's charge now in the dark region until the final region, region n. Then that charge is 
shifted out with Mn/{a + c + . . . +«) vertical shifts (step 1342) and out with N horizontal 

20 shifts (step 1344). The process for one measurement then ends. In practice, of course, 
the readout process loops around and continues by clearing the dark region (step 1302) 
until all measurements have been taken. 

During the time the charge stored in the dark region is being read out, unwanted 
charge is accumulating in regions a, c, . . . , and n in the upper half of the array. Should 
25 another measurement be desired (step 1350), the measurement cycle commences with the 
unwanted charge being cleared from the regions a, c, . . . , and n in the upper half of the 
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array as before in M vertical shifts (step 1302). The process continues as described above 
until no further measurements are desired (step 1350). 

In the process described above, charge accumulated in each of the regions a, c, 
. . and n is read out in a single series of vertical shifts, i.e., there is only one horizontal 

5 shift for each of the regions a, c, . . . , through n. But, on analogy with the biftircation of 
the entire array in Fig. 5 into separate regions a and b, each distinct region a,c,.,., 
through n. in Fig. 12 may be further subdivided. For example, region a may be fiarther 
subdivided into region a' and a complementary region, region b, where a = a' + b, 
affording the advantages detailed above with respect to enhanced dynamic range. All, 

10 any or none of the regions may be subdivided as desired. Furthermore, the details of the 
subdivision may be changed at will between readout cycles without departing from the 
scope and spirit of the invention. 

The corresponding structures, materials, acts, and equivalents of all means or step 
plus function elements in the claims below are intended to include any structure, material, 

15 or act for performing the function in combination with other claimed elements as 

specifically claimed. The description of the present invention has been presented for 
purposes of illustration and description, but is not intended to be exhaustive or limited to 
the invention in the form disclosed. Many modifications and variations will be apparent 
to those of ordinary skill in the art without departing from the scope and spirit of the 

20 invention. The embodiment was chosen and described in order to best explain the 

principles of the invention and the practical application, and to enable others of ordinary 
skill in the art to understand the invention for various embodiments with various 
modifications as are suited to the particular use contemplated. 
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